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(54) DEVICE FOR COUNTING FISH POPULATION PASSING THROUGH A HSH PASS 



(57) A fish population counting device for counting 
the number of fish passing through the fish pass accord- 
ing to directions and fish sizes. Image data produced by 
the two-line camera (1) that takes pictures simultane- 
ously on two shooting lines (A, B) is sent through the 
A/D converter (2) and stored one line at a time in image 
memories (3A. 3B). The image data is then transfen-ed 
to the processing unit (6), where they are rearranged in 
the order of shooting for each shooting line (A, B) to 
generate two-line successive images (A, B). From these 
two-line successive images (A. B). the outlines of the 
areas whose label numbers are the same are traced to 
separate massive figures scattered in tiie images. The 
features of tiie massive figures are extracted and 
matched against a standard pattern to decide if the 
massive figures are fish or not. Then, tiie positions and 
shapes of all fish scattered in tiie two-line successive 
Images (A, B) are identified one by one to count tiie 
number of fish ttiat have passed tiirough the shooting 
lines (A. B) during a predetermined length of time. Fur- 
ther, individual fish that are at displaceable positions are 
taken to be tiie same fish and, based on the displace- 



ments of ttiese fish, the directions and speeds of these 
Individual fish are calculated. From the fish speeds tiie 
size of each fish is determined. The number of fish is 
counted by tiie size and tiie direction. 
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Description 

Technical Field: 

[0001] The present invention relates to a device for s 
automatically counting fishes passing through a 
selected point in a given nanw water passage. 

Related Background Art: 

10 

[0002] Hitherto, fishes passing through a selected 
point in a given water passage have been counted by 
sight by persons standing at selected places along the 
water passage. Such counting, however. Is difficult to be 
continued an elongated time without lowering the accu- is 
racy. 

[0003] It has been proposed that pictures of fishes are 
taken by a piece of electronic equipment used to take 
pictures (caDed hereinafter " Video Camera' or "Canv 
era"), which is set at a selected point in a given water 20 
passage, and that the pictures are analyzed to deter- 
mine the number of fishes passing through the selected 
point in the water passage. 

[0004] The video camera takes pictures intennittently, 
fbr example, one each 1/30 seconds. The number of 2s 
fishes, therefore, cannot be determined without taking 
account of displacements of fish images by comparing 
two subsequent pictures all the time. 
[0005] The video camera has a relatively wide range 
of horizontal view. It is, therefore, necessary that the 30 
video camera be protected against the reflection of sur- 
rounding light from the water surface. Fbr examples, the 
area of the water surface which the video camera can 
span is covered by anti-reflection sheet, or othenmse, 
the video camera is put in a water-proof enclosure to be ss 
submerged below the water surface. 
[0006] With a view to solve these problems the same 
applicant as the present application filed a patent appli- 
cation disclosing a device fbr taking pictures of fishes 
passing through a selected point in a given nanrow 40 
water passage with a linear video camera to analyze 
and determine the number of fishes from such pictures 
(see Japanese Patent Application Laid-Open N0.6- 
196139). 

[0007] Disadvantageously this counting device is 45 
insensible to the direction in which fishes swim to pass 
through the selected point In the water passage, so that 
it cannot make any decision as to whether the so 
counted fishes swim upstream or downstream. 
[0008] Fish images appearing in the pictures taken by so 
the linear video camera are liable for tfieir total lengths 
to vary with swimming speed: the image of fishes of 
same length is shortened when the fishes pass through 
the selected point quickly whereas the image of fishes 
of same length is elongated when the fishes pass ss 
through the selected point slowly. Therefore, the fish 
size cannot be determined, and the number of fishes 
cannot be determined in terms of kinds, which may be 



given in terms of size. Assume that salmon passing 
through a selected point In the water passage are 
counted, and that small fishes other than salmon swim 
slowly, such foreign fishes are erroneously counted to 
yield a wrong count of salmons. 

[0009] In view of the above the object of the present 
invention Is to provide a fish counting device which is 
sensible to the size of fishes, in terms of which fish kinds 
can be determined, thereby permitting the counting of 
fishes in terms of fish kinds, and which is sensible to in 
which direction fishes pass through the selected point. 

Disclosure of the Invention: 

[0010] A device for counting fish population passing 
through a selected point in a given water passage com- 
prises: 

a two-line camera fbr taking linear pictures along 
two parallel lines traversing the water passage at 
regular time intervals to store the linear-dimen- 
sional image data; 

means for providing two time-sequential arrange- 
ments of the linear-dimensional image data of the 
pictures taken for a predetemiined length of time, 
each representing the time-sequential event as 
viewed from each line; 

means for retrieving different shapes appearing in 
the time-sequential event thus represented; 
means fbr determining whetiier each of tiie so 
retrieved shapes is a fish or not; 
means for comparing the so determined fish 
shapes appearing in one of the two time-sequential 
arrangement of linear pictures with those appearing 
in the otiier time sequential arrangement of linear 
pictures in terms of tiieir relative positions to deter- 
mine the displacement of each fish shape; 
means responsive to the so determined displace- 
ment of each fish for determining in which direction 
tiie fish shape passes through tiie selected point in 
ttie water passage; 

means fbr determining the speed of each fish 
shape from its displacement; and 
means for determining the time taken for each fish 
shape to pass through tiie selected point, lasting 
from the instant at which the moutii of the fish 
shape reaches tiie selected point to the Instant at 
which the caudal fin of tiie fish shape leaves ttie 
selected point, and fbr determining the fish size 
from the so determined time and speed, 
whereby the number of fish passing through ttie 
selected point fbr tiie predetermined length of time 
may be determined in terms of the fish size and the 
direction. 
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Brief Description of the Drawings: 
[0011] 

Fig.1 is a t)locl^ diagram showing a dence for count- 
ing fish population passing through a selected point 
in a given water passage according to the present 
invention; 

Fig.2 Is a side view of the water passage, illustrating 
how a twO'line camera is positioned; 
Fig.3 is a plane view of the water passage, illustrat- 
ing how the two-line camera is positioned; 
Fig.4 Is a flow chart representing the image- 
processing effected in the fish population counting 
device; 

Fig.5 illustrates examples of two time-sequential 
an'angements of the linear-dimensional image 
dale, each representing the time-sequential event 
as viewed from each line; 

Fig.6 illustrates two time-sequential anangements 
of linear pictures A and B, indicating that fish 
shapes move from the picture-taking line A to the 
picture-taking line B; and 

Fig.7 illustrates two time-sequential anangements 
of linear pictures A and B, indicating that fish 
shapes move from the picture-taking line B to the 
picture-taking line A. 

Best Mode of Reducing the Invention to Practice: 

[001 2] With reference to the accompanying drawings 
a preferable emtxxiiment of the present Invention is 
desaibed below. 

[001 3] Fig.1 is a block diagram showing a device for 
counting fish population passing through a selected 
point In a given water passage according to the present 
invention. 

[0014] In Fig.1 parts 1 to 3 make up a recording sec- 
tion for recording the sequential pictures of two parallel, 
linear areas selected in the water passage, and parts 6 
and 7 make up an analyzing section for analyzing the 
image data of the pictures recorded In the recording 
section. A two-line camera 1 takes two llnear-ptotures 
simultaneously. 

[001 5] A linear camera uses a linear sensor as photo- 
electric converter. The linear sensor is a signal-transfer- 
ring type of image sensor, which is composed of a linear 
anangement of light-receiving elements such as CCDs. 
[001 6] The two-line camera may be a set of two linear 
cameras arranged front and rear, or a single camera 
having a prism for separating a single optical axis into 
two divisional axes each directed to two linear sensors 
for taking the pictures of two linear zones simultane- 
ously. 

[0017] Pieces of information of color densities pro- 
vided by the two-line camera 1 are convened by an A^ 
converter 2 to be stored for each of tiie two linear zones 
simultaneously in two image memories 3A and 3B. 



[0018] A display device 4 shows the contents of the 
Image memories 3A and 3B In the Ibrm of separate pic- 
tures. 

[0019] A controller 5 controls the two-line camera 1, 
5 the A/D converter 2 and the image memories 3A and 3B 
according to a predetermined proceeding. 
[P02q] An image processing unit 6 Includes a compu- 
ter and other electronics fbr taking In required data and 
for effecting required image analyses. 
10 [0021] The image processing unit 6 stores reference 
fish patterns relative to which a decision can be made 
as to whether the moving objects appearing in the pic- 
tures are fish or not. 

[0022] A display 7 shows a series of pictures of the 
15 water passage taken by the two-line camera 1 along 
with the results of measurement 
[0023] Now, one example of counting fish population 
passing through a selected point in a given water pas- 
sage is described. 
20 [0024] Refemng to Flgs.2 and 3. a light-projecting unit 
8 is laid on the bed of the water passage to throw tiie 
beam of light upward, traversing tiie water passage lat- 
erally along two picture-taking lines A and B. 
[0025] The light-projecting unit 8 comprises a spot 
25 light source 8a and a spot-to-linear beam converter 8c 
connected to tiie spot light source 8a via a length of 
optical f ber 8b. 

[0026] The two-line camera 1 1s positioned just above 
the picture-taking lines A and B, thus permitting the tak- 
30 ing of the pictures of the linear zones of water passage 
defined by the lines A and B respectively. 
[0027] Three to five hundred pictures are taken each 
second. 

[0028] The two-line camera needs to be positioned 
35 above the water passage, but the other units may be put 
(several hundred meters) apart from the water passage. 
[0029] It Is of most concern to select the place where 
the two-line camera is positioned. 
[0030] The lateral dimension (perpendicular to tiie 
40 water passage) of each linear zone is equal to tiie widtti 
of the water passage whereas tiie longitudinal dimen- 
sion 0>arallel to the water passage) is several millime- 
ters to one centimeter long (dependent on required 
precision or tiie wkltii of the water passage). 
45 [0031 ] The picture-taking lines A and B are separated 
several millimeters to approximately ten centimeters 
(two linear cameras arranged front and rear) apart from 
each other. 

[0032] The two-line camera 1 is fixed to a support 
50 board, which is 20 cm wide to suppress undeslred 
reflection of light in tiie picture-taking area. 
[0033] The two-line camera 1 is relatively light, and 
ttierefore, it suffices that the support board be strong 
enough to support its own weight. 
55 [0034] A bridge across tiie water passage may be 
used to hold the two-line camera above the water pas- 
sage, provided that the height from the water passage is 
permitted. 
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[0035] The raised level at which the two-line camera 1 
is posmoned abcve the water passage can be deter* 
mined from the focal length of the lens although the 
width of the water passage and surrounding conditions 
still remain as factors for detemiining the raised level at 
which the camera is positioned. 
[0036] Refening to Rg.4, the manner In which images 
are processed in the fish population counting device Is 
desaibed. 

[0037] At first, the two-line camera 1 takes linear pic- 
tures along two parallel lines A and B simultaneously. 
[0038] The linear sensors of the two-line camera 1 
provide analog data of the so taken pictures sequen- 
tially at their output tenninals. 
[0039] The data thus outputted are convened to cor- 
responding digital data by the A/D convener 2 to be 
stored for each linear picture in the image memories 3A 
and SB allotted to the picture-taking lines A and B 
reapectively. 

[0040] The image data are transferred from the Image 
memories 3A and 3B to the image processing unit 6 
(SI). 

[0041 ] The image processing unit 6 provides two time- 
sequential anrangements of the linear-dimensional 
Image data or linear pictures A and B (see Fig.5). each 
representing the time-sequential event as viewed from 
each picture-taking line A or B (S2). 
[0042] The two time-sequential anrangements of linear 
pictures A and B are scanned across their whole areas 
to distinguish areas in terms of their color densities fbr 
separating different shapes of one color density from 
those of the other color density (S3). 
[0043] Different shapes of one or the other color den- 
sity are compared with the reference fish patterns repre- 
senting fish shapes to make a decision as to whether 
they are fish or not (84). 

[0044] Each and every fish shape In the two time- 
sequential arrangements of linear pictures A and 6 is 
determined in its shape and position to calculate the 
number of fish shapes passing through the picture-tak- 
ing lines A and B for the predetermined length of time 
(S5). 

[0045] Each and every fish shape in the two time- 
sequential anrangements of linear pictures A and B is 
conrpared to determine which fish shapes are within a 
presumable distance, regarding the two fish shapes 
thus found within the presumable distance as one and 
same fish shape, thus determining the ^mming direc- 
tion and speed from the displacement of one and same 
fish shape (S6). Two fish shapes appearing apart from 
the presumable distance( or too apart from the distance 
within which one and same fish can move in a certain 
limited tinte) In the two time-sequential arrangements of 
linear pk;tures are dfferent fish shapes. 
[0046] The time taken for each fish shape to pass 
through the selected point is determined, lasting from 
the instant at which the mouth of the fish shape reaches 
the selected point to the instant at whteh the caudal fin 



of the fish shape leaves the selected point, and the fish 
size is determined from the so determined time and the 
swimming speed already determined. Thus, the number 
of fish passing through the selected point for the prede- 
5 termined length of time are determined in terms of the 
fish sizes (\.e. fish kinds) and the swimming direction. 

[p047] The pieces of infbrmatton thus collected are 
shown along with time IncGcation in the display 7 (88). 
[0048] As for determination of the swimming direction: 

10 referring to Rg.6, a fish shape appears first in tiie time- 
sequential anangement of linear pictures A which 
shows an earlier event in the water passage (at early 
time t1), and then the fish shape appears in the time- 
sequential arrangement of linear pictures B which 

75 shows a sequential or later event in the water passage 
(at later time t2), and then it is determined that the fish 
shape moves from the picture-taking line A to the pic- 
ture-taking line B. 

[0049] Referring to Rg.7, conversely, a fish shape 

20 appears first in the time-sequential arrangement of lin- 
ear pictures B (at early time t1). and then the fish shape 
appears in tiie time-sequential arrangement of linear 
pictures A (at later time t2), and then it is determined 
tiiat the fish shape moves from the picture-taking line B 

2S to the picture-taking line A. 

[0050] As seen from Figs.6 and 7, when image data 
are arranged in the order in which pictures were taken, 
every fish shape is directed with its mouth up and its 
caudal fin down whether it swims upstream or down- 

30 stream; the fish swims with its mouth directed In the 
direction In which it swims all the time no matter In which 
direction it may swim, upsfream or downsfream. 
[0051 ] As for the swimming speed : from the time inter- 
val between time t1 and time t2 in the time-sequential 

35 arrangements of linear pictures A and B it can be deter- 
mined how long it takes to pass from the pk;ture-taking 
line A (or 6) to the picture-taking line B (or A), and the 
swimming speed can be determined by dividing the dis- 
tance between the picture-taking lines A and B by the so 

40 determined length of time. 

Industrial Utility: 

[0052] As may be understood from the above, two lin- 
45 ear pictures traversing a given water passage at a 
selected point are taken simultaneously to provide two 
series of time-sequential arrangement of linear pictures, 
tiieretsy perntitting measurement of the displacement of 
each arid every fish shape In tenns of fish positions 
50 appearing in the two series of time-sequential arrange- 
ment of linear pictures to determine the swimming direc- 
tion and speed of each and every fish in the water 
passage. 

[0053] Thus, the numbers of fishes swimming 
55 upstream or downstream can be counted respectively in 
terms of swimming directions. 
[0054] Also, the fish size can be determined from the 
swimming speed and the time difference between the 
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instant at which the mouth of the fish reaches the 
selected point and the instant at which the tail fin of the 
fish leaves the selected point in the water passage. 
Thus, the numbers of fishes can be counted in terms of 
fish sizes or kinds. s 

Claims 

1. A device for counting fish population passing 
through a selected point in a given water passage io 
comprises: 

a two-line camera Ibr taking linear pictures 
along two parallel lines traversing the water 
passage at regular time intervals to store the is 
linear-dimensional image data; 
means for provkiing two time-sequential 
arrangements of the linear-dimensional image 
data of the pictures taken for a predetermined 
length of time, each representing the time- so 
sequential event as viewed from each line; 
means for retrieving different shapes appearing 
in the time-sequential event thus represented; 
means for detemrtining whether each of the so 
retrieved shapes is a fish or not; 25 
means for comparing the so determined fish 
shapes appearing in one of the two time- 
sequential an'angements of linear pictures with 
those appearing in the other time sequential 
anangement of linear pictures In terms of their 30 
relative positions to detemnlne the displace- 
ment of each fish shape; 
means responsive to the so determined dis- 
placement of each fish shape for determining in 
which direction the fish shape passes through 3S 
the selected point in the water passage; 
means for determining the speed of each fish 
shape from its displacement; and 
means for determining the time taken for each 
fish shape to pass through the selected point, 40 
lasting from the instant at which the mouth of 
the fish shape reaches the selected point to the 
instant at which the caudal fin of the fish shape 
leaves the selected point, and for determining 
the fish size from the so determined time and 4S 
the speed of the fish shape already deter- 
mined, 

whereby the number of fish passing through 
the selected point for the predetermined length 
of time may be determined in terms of the fish so 
size and the direction. 
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